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FIELD OF THE INVENTION 

This invention relates generally to redundancy techniques in dependable systems. More 
particularly, it relates to a voter design for use in a redundant system. 

5 

BACKGROUND 

Redundancy techniques such as duplication and Triple Modular Redundancy (TMR) are 
commonly used for designing dependable systems to ensure high rehability, availability and 
data integrity. TMR is an example of a redundancy scheme that is used for fault-masking. A 
)^ good reference for TMR is Von Neumann, J., "Probabilistic Logics and the Synthesis of 
^j! Reliable Organisms from UnreUable Components " Automata Studies, Ann, of Math Studies, 
55f no. 34, C. E. Shannon and J, McCarthy, Eds., Princeton University Press, pp. 43-98, 1956. In 
I II a TMR system, one uses three (same or different) implementations of the same logic function 
iM and the outputs of all the implementations are connected to a voter as shown in FIG. 1. There 
If are numerous examples of dependable systems using the TMR technique as, for example, 

m 

Q described by Siewiorek, D. P. and R. S. Swarz, Reliable Computer Systems: Design and 
f4 Evaluation, Digital Press, 1992. 

For voting on the outputs of the individual modules, majority voting circuits are generally 
20 used in TMR systems. FIG. 2 shows a design of a majority voting circuit. In FIG. 2, Zi\ 

Zi and Zi are the outputs corresponding to the bit position Z\ of the three modules of the 
TMR system as shown in FIG. 1. The corresponding voted output bit of the system is Zi. 
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In TMR systems, majority voting is normally performed on a bit-by-bit basis. For a system 
with n outputs, conventional TMR systems use n single-bit voters. FIG. 3 shows the 
implementation of such a TMR system with two outputs Zi and Z2. 



The prior art teaches rehabiUty modeling of TMR systems as, for example, in Trivedi, 
Probability and Statistics with Reliability, Queuing, and Computer Science Applications, 
Prentice Hall, Englewood Chffs, NJ, USA, 1982. For the classical TMR system shown in 
FIG. 1, the reliability R is given by the following expression: 

R=K + 3Rl{l-RJ 

In the above expression, R^n is the reliability of each individual module in the TMR system. 
The above expression follows from the fact that for the TMR system to produce correct 
outputs, at least two of the three modules must produce correct outputs. 

The classical reliability expression for TMR systems is optimistic because it does not consider 
common-mode failures. Lala observed that one must pay attention to the problem of 
common-mode failures (CMFs) as published in Lala, J. H. and R. E. Harper, "Architectural 
Principles for Safety-critical Real-time Applications," Proc, of the IEEE, Vol. 82, No. 1, pp. 
25-40, Jan. 1994. CMFs result from failures that affect more than one module of the 
redundant system at the same time, generally due to a common cause. They can be design 
faults or operational faults due to external (such as EMI and radiation) or internal causes. For 
example, a radiation source causing multiple-event upsets may lead to the failure of more than 
one module in a TMR system as taught, for example, by Reed in Reed, R., et aU "Heavy Ion 
and Proton-Induced Single Event Multiple Upset," IEEE Trans, on Nuclear Science, Vol. 44, 
No. 6, pp. 2224-2229, July 1997. There is no built in facility in conventional TMR voters to 
detect this situation and initiate appropriate actions. 



PATENT APPLICATION 



SOO-086 



Accordingly, there is a need for new voter designs for TMR systems that are useful in the 
context of common-mode and multiple failures that affect multiple modules in a TMR 
system. More generally, there is a need for new voter designs for modular redundant systems. 



SUMMARY OF THE INVENTION 

The present invention provides a voter for a redundant system with n modules wherein each 
of these n modules generates a word output. The word voter of the present invention receives 
word outputs from each of the n modules. Each word contains two or more bits. A voter 
decision is generated by the word voter utilizing a word basis of the word output of each of 
the n modules. The voter is based on a majority voting principle. The word voter contains 



f \ 
n 

\nl2\ 



matching circuits. The matching can be based on exact matching or inexact matching 



depending on the type of signal. Inexact matching could for instance be threshold matching. 
The word voter of the present invention also generates an error signal when not a majority of 
modules in the n modules produces the same word output. This error signal could actually be 
a self-checking error signal. The word voter of the present invention could consider an entire 
word of each word output or just a subset of each word of each word output. 

The redundant system is usually a circuitry system such as a logical circuitry module. 
However, the present invention is not limited to also having a data or signal processing 
module. In several embodiments, the present invention is shown using a triple modular 
redundancy system wherein n equals 3 modules. In another embodiment, the present 
invention is shown using a triple modular redundancy simplex system wherein n equals 3 
modules and configures itself to a simplex system that includes a non-faulty module wherein 
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n equals 1 module in case one of n modules becomes faulty. The redundant modular systems 
could include modules with different implementations though with the same functionality, or 
modules with the same implementations and the same functionality. 

5 The present invention also provides a method of designing circuitry systems. The method 
steps include the step of providing a redundant system with n modules wherein each of these 
n modules generates a word output. Then a word voter is provided to receive these word 
output from each of the n modules, where after a voter decision is generated by the word 
voter utihzing a word basis of the word outputs of each of the n modules. In addition, the 
10 present invention provides a method wherein the word voter is used in hardware systems. 

Furthermore, the present invention shows embodiments of hardware implementations of the 

HI 

^ word voter. First, a word voter with n outputs for a triple modular redundancy system is 
'yi provided that includes three pair-wise matching circuits each having n XNOR gates and n 2- 
15 input AND gates to receive output vectors of modules of the triple modular redundancy 
f 0 system. In addition, this word voter includes 2n 2-input AND gates and n 2-input OR gates to 
f il generate the n outputs. This word voter could also include a one 3-input NOR gate to 
generate an error signal independent of the number of n outputs. 

20 Second, a word voter with n outputs for a triple modular redundancy simplex system is 
provided that includes three pair-wise matching circuits each having n XNOR gates and n 2- 
input AND gates to receive output vectors of modules of the triple modular redundancy 
simplex system. In addition, this word voter includes 2n 2-input AND gates and n 2-input 
OR gates to generate the n outputs. This particular word voter for simplex systems also 

25 includes five 2-input AND gates and three 2-input OR gates independent of the number of n 
as well as three flip-flops also independent of the number of n. Again, this word voter also 
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includes one 3 -input NOR gate to generate an error signal independent of the number of n. 
Third, and more general, a word- voter with n outputs for a N modular redundancy system is 



provided that includes a 



( N ^ 



In/2\ 



matching circuits which can be designed in different ways. 
The present invention provides two ways for designing these matching circuits. First, these 

matching circuits have n sub-circuits each containing two 1^ /2]_input AND gates and one 
2-input OR gate. Second, these matching circuits have a minimum number of pair-wise 
matching circuits, wherein the minimum number is derived for each the N using a commonly 
known covering procedure. In addition, these pair-wise matching circuits each also have n 
XNOR gates and n 2-input AND gates to receive output vectors of modules of the N modular 
redundancy system and AND gates to combine the output vectors of these pair-wise matching 



circuits. The general word voter also includes one 
error signal independent of the number of n. 



\n/2\ 



■input NOR gate to generate an 



In view of that which is stated above, it is the objective of the present invention to provide a 
word voter design for redundant systems, in which voting decisions are made on a word basis 
rather than a bit basis. 



It is another objective of the present invention to improve data integrity by at least an order of 
magnitude over conventional systems with bit-by-bit voting. 



It is yet another objective of the present invention to provide a word voter in redundant 
systems to avoid incorrect results in the event of common-mode failures such as design faults 
or operational faults or multiple faults. 
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It is still another objective of the present invention to provide a word voter for TMR systems. 

It is still another objective of the present invention to provide a word voter for TMR-Simplex 
systems. TMR-Simplex systems are widely used for their higher reliability compared to 
TMR systems. 

It is still another objective of the present invention to provide a word voter for N-modular 
redundancy systems. 

It is still another objective of the present invention to provide a word voter for redundant 
systems with multiple outputs. 

It is still another objective of the present invention to provides a word voter for hardware 
systems. 

The advantage of the present invention is that the word voter can be used to design redundant 
systems, such as, but not limited to, TMR systems or N-modular redundancy systems, that are 
protected against conmion mode and multiple output failures. In addition, another advantage 
of the present invention is that it provides for a technique to efficiently design a TMR simplex 
system. 

BRIEF DESCRIPTION OF THE FIGURES 

The objectives and advantages of the present invention will be understood by reading the 
following detailed description in conjunction with the drawings, in which: 
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FIG. 1 An example of a triple modular redundancy system. 

FIG. 2 An example of a majority voting circuit; 

FIG. 3 An example of a TMR system with bit-wise voting; 

FIG. 4 A TMR system with word voter according to the present invention; 

FIG. 5 A word voter for a system with n outputs Zj, Z„ depicting a complete design 

according to the present invention; 
FIG. 6 A word voter for a system with n outputs Zi, Z„ and a matching circuit 

Matchij according to the present invention; 
FIG. 7 An illustration of data integrity of a TMR system with word voting according to 

the present invention; and 
FIG. 8 A TMR- simplex system using a word voter according to the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 

Although the following detailed description contains many specifics for the purposes of 
illustration, anyone of ordinary skill in the art will readily appreciate that many variations and 
alterations to the following exemplary details are within the scope of the invention. 
Accordingly, the following preferred embodiment of the invention is set forth without any 
loss of generaUty to, and without imposing limitations upon, the claimed invention. 

The present invention provides a new voter design for redundant systems called the word 
voter. That is, the entire output word from each module in a redundant system is considered 
when making the decision. However, the present invention is not limited to considering the 
entire word since also a subset of the word can be used when making a decision. In a 
preferred embodiment of the present invention, the word voter utilizes a majority voting 
principle. For example in case of TMR systems, if no two modules generate the same output, 

8 
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then the voter returns an error signal rather than an output value. In general, the redundant 
systems include n modules and in that case majority voting is when a majority generates the 
same output. In a TMR systems, there are 3 modules. Each module can have different 
implementations though with the same functionality. However, each module can have the 
5 same implementations with the same functionality. As an exemplary embodiment of the 
present invention, FIG. 4 shows a TMR system 400 with two outputs 410 and 420, and a 
word voter 460. Examples of modules that could be used as building blocks or modules of a 
redundant system are, for instance, but not limited to data or signal processing modules and 
logical circuitry modules. The present invention also includes signal processes from, for 
10 instance, but not limited to, a human operator waiving his/her hand whereby the hand 
^jf movement is detected by hardware and translated in, for instance, a Boolean signal. A TMR 
system requires three copies (either the same or different implementations) of a given module, 
i.e. 430, 440 and 450, to form TMR system 400. In FIG. 4, suppose that a failure source 

^1 causes faults in the first 430 and the second 440 modules of TMR system 400. Due to the 

10 

15 presence of the fault in Module 1 430, in response to a particular input combination, module 1 

kj 

m 430 produces an output combination 10 instead of 01. Zi^ and Z2^ are the bit outputs 430A 

^Jf and 430B that define the word or output combination that correspond to module 1 430. 

i ' 'i 

h^u Similarly, due to the presence of the fault in Module 2 440, the output combination obtained 
from Module 2 440 is 11. Zi^ and Z2^ are the bit outputs 440A and 440B that define the word 

20 or output combination that correspond to module 2 440. Finally, in this example, Module 3 
450 is fault-free and produces an expected output 01. Zi^ and Z2^ are the bit outputs 450A 

and 450B that define the word or output combination that correspond to module 3 450. The 
outputs of each module in TMR system 400 is shown in Table 1. 
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As shown in Table 1, with bit-wise voting, the voter corresponding to the first output bit 
produces a 1 and the one corresponding to the second output bit produces a 1. Thus, 11 is the 
result at TMR system 400 output. However, if one considers the output word from each 
module 430, 440 and 450, the output words from all the three modules are found to be 
different. The output words from the first 430, second 440 and third 450 modules are 10, 11 
and 01, respectively. This can be treated as an erroneous condition for a voter, which works 
on a majority voting principle, because, no two output words are equal. Based on this 
observation, one can modify the classical voter design by adding extra circuitry that detects 
this error condition and produces an error 470. The error signal can be a self-checking error 
signal. Thus, the TMR system with the word voter 460 is capable of maintaining data 
integrity for this example in FIG. 4. In response to the error signal 470, appropriate action 
(depending on the application) can be initiated. 



Table 1 . An example of voting in a TMR system 



Module 


Fault-free Outputs 


Faulty Outputs 


1 


0 1 


1 0 


2 


0 1 


1 1 


3 


0 1 


01 


Bit-wise Voting 


0 1 


1 1 


Word-wise Voting 


01 


No majority 
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FIG. 5 shows an exemplary embodiment of word voter 500 for a TMR system where each 
module has n outputs. Let Z^* denote the output vector from the module. For example, 
denotes the output vector from the module. Also, let Z/ denote the bit of ZK For 
example, Zj* denotes the bit of Z^. Word voter 500 produces outputs Zi ... Z^, 

5 

FIG. 6 shows an exemplary embodiment of a pair-wise matching circuit Matchij 600, which 
produces output 610, for instance, a 1 if and only if modules i and; produce the same output 
word. Pair-wise matching circuit Matchfj 600 in FIG. 6 is an example of a pair-wise matching 
circuit of either Matchi^i 510, Matchi^s 520, or Match2^3 530 as shown in FIG. 5. As in FIG. 
10 5, Zf denotes the bit of Z' which is the output vector from the i^^ module. For example, Zj^ 

\p denotes the bit of the output vector of the module. 

?H 
^ u 
in 

fll Following the example in Table 1, for a particular input combination, the three modules 
ej produce the following outputs: Zi^ = 1, = 0, Z^^ = 1, = 1 and Zj^ = 0, Zj^ = 1. 
If Referring to FIG. 5, Matchi^2 510 = Matchi,^ 520 = Match2,3 530 = 0 and the ERROR signal 

ill 

f| 540 equals 1. 

Q 

In the following example, a situation is considered where the output words from at least two 
modules match. In that case, the ERROR signal 540 will not be equal to L If the output 
20 words from modules 1 and 3 match, word voter 500 in the TMR system produces an output 
word that is the same as the one produced by module L If the output words from modules 1 
and 3 do not match (i.e., Matchi^^ = 0), then the output word produced by word voter 500 is 
equal to the one produced by module 2. 



25 



Use of median voters has been proposed in the past for voting purposes in TMR systems as, 

for instance, in Dennis, N. G., "Ultra-reliable Voter Switches with a Bibliography of 
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Mechanization," Microelectronics and Reliability, pp. 299-308, August 1974. In a TMR 
system, a median voter selects the median of the output words from the three modules to be 
the output of the TMR system. For that purpose, the voter performs a magnitude comparison 
of the output words from the three modules. Although it is not obvious to make a median 
voter as a word voter, a median voter can be modified to operate as a word voter. If someone 
were just to take a median voter design, they cannot implement a word voter. In the case of a 
median voter, an error signal is generated if the magnitudes of the outputs of the three 
modules are different. Since a median voter performs magnitude comparison, its area 
overhead is generally more than the design in FIGS. 5 and 6. 

The word voter of the present invention detects erroneous conditions that can otherwise 
produce incorrect outputs with bit-by-bit voting. The present invention enhances data 
integrity of a TMR system. For quantifying the data integrity enhancement, a metric s can be 
used. Metric s is defined as the probability that a TMR system with the word voter will 
produce an error signal at least once before producing an incorrect output combination, in the 
presence of multiple module failures. S is estimated as the percentage of cases for which the 
word voter generated the error signal at least once before the system generated incorrect 
outputs. The estimated value of s increases with increasing number of outputs. This is 
intuitive since, the more outputs, the more is the possibility that the output words from the 
three circuits are different. Note that if there is a single module fault, there will be no ERROR 
signal. Data integrity of a TMR system with the word voter of the present invention is 
improved. Data integrity of a TMR system is defined as the probabiUty that the system does 
not produce corrupt (incorrect) outputs before indicating an erroneous situation in any of the 
previous cycles. 
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As an example, a discrete time model of a TMR system is considered. In this discrete time 
model, time is divided into discrete increments called cycles and inputs are applied at the 
beginning of each cycle. Consider a TMR system with a word voter where the probability 
that a module produces correct outputs in any given cycle is R^, In addition, suppose that s is 
the probability that the word voter in the TMR system produces an error signal at least once 
before producing corrupt (incorrect) outputs when two modules fail. In this case, the data 
integrity of the system up to time T is given by the following expression: 

+ 3i?2^[l - (1 - R^f] + 3srI[1 - (1 - R^ff 

The above expression follows from the fact that when at least two modules are working 
correctly, the system always produces correct outputs. However, when two modules are 
faulty, data integrity is maintained when the system produces the error signal at least once 
before producing corrupt outputs. Hence, the factor s appears in the third term of the above 
expression. 

FIG. 7 shows the data integrity 710 of a TMR system with the word voter for different values 
of 5, such as 720 and 730. The simplex reliability is equal to 1 - lO-^^. On the X-axis 
740, the mission time of the system is measured and 1 unit of time corresponds to the MTTF 
(Mean Time to Failure) of a simplex system (consisting of only one module). It is clear from 
FIG. 7 that the data integrity improves at least by an order of magnitude for increasing values 
of s. A TMR system with the classical bit-by-bit voter has s equal to 0. FIG. 7 shows the 
effectiveness of using word voters for designing TMR systems with high data integrity. 



As discussed above, the word voter of the present invention produces an error signal when the 
three modules of a TMR system produce different output combinations. However, that does 
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not mean that the TMR system will always produce incorrect outputs in this situation. This is 
illustrated using the example in Table 2. 



Table 2, Correct outputs from a TMR system in the presence of multiple module 

Failures 





Ffli ilt-froo Oi itni itc 
ICIUII licc wUL|JULo 


Fiii ilt\/ Oi itni itc 
nciuiiy wUL[Juio 


1 


000 


100 


2 


000 


010 


3 


000 


000 


Bit-wise 


000 


000 


Word-wise 


000 


No majority 



In the exemplary TMR system of Table 2, all the three modules are supposed to produce the 
output combination 000 in the fault-free case. However, due to the presence of faults in the 
first and the second modules, Module 1 and Module 2 produce output vectors 100 and 010, 
respectively. Although the output vectors from the three modules are different, a bit-by-bit 
voting scheme will produce the correct combination 000 at the system output. This situation 
is an example of a compensating fault. Note that, the word voter design of the present 
invention will indicate an error signal in this case. Thus, with the word voter design of the 
present invention, error signal may be indicated for some compensating faults in the system. 
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For use in dependable systems, it is important for the user to receive the error signal as an 
indication that something wrong is going on which is not guaranteed to be tolerated by the 
system. 

5 Compared to a TMR system with a bit-by-bit voter, the extra hardware needed by a TMR 
system with the word voter is of the order of one 2-input logic gate and three XNOR gates for 
each output of the TMR system. This is because, for a TMR system with n outputs, the 
number of equivalent 2-input gates required by the word voter and the bit- wise voter are 6n -h 
2 and 5n, respectively. In addition, the TMR system with the word voter needs 3n XNOR 
10 gates. The derivation is shown in the next paragraph. 

In general, according to FIGS. 5 and 6, a word voter 500 with n outputs Zj ... for a triple 
JIJ modular redundancy system, includes three pair-wise matching circuits (510, 520 and 530) 

each having n XNOR gates 620 and n 2-input AND gates 560 to receive output vectors (502, 
15 503, 504, 505, 506 and 507) of the modules of the triple modular redundancy system. In 
Ml addition, the word voter 500 with n outputs for a triple modular redundancy system, includes 

2n 2-input AND gates 560 and n 2-input OR gates 570 to generate said n outputs Zj Z^. 
f.:^ The word voter further includes a 1 3-input NOR gate 550 to generate an error signal 540 

independent of number of n outputs Z^... Z^. For the word voter design 500 of FIG. 5, the 
20 delay in generating the final voted output is of the order of log2n 2-input gate delays (due to 

the presence of n-input AND gates in the matching circuits). 

The word voter design of the present invention can be modified to guarantee that the data 
outputs (but not the ERROR signal) will be produced without any extra gate delay compared 
25 to conventional TMR systems. In this case, one can use the conventional bit-by-bit voters to 
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produce the voted outputs. For generating the ERROR signal, one can use the part of the logic 
circuit of FIG. 5 that generates the error signal 540, In this case, the extra area overhead of 
the word voter design over a bit-by-bit voter is 3 n-input AND gates, 3n XNOR gates and 1 3- 
input NOR gate for a TMR system with n outputs. This is equivalent to 3n 2-input gates and 
3n XNOR gates. It may be noted that, for a hybrid redundant n-output system with TMR core 
the overhead of 3n XNOR gates in the word voter design disappears. 

The MTTF (Mean Time To Failure) of a TMR system is lower than that of the corresponding 
simplex system (containing only one module). Moreover, for mission time greater than 
seven-tenths of the MTTF of a simplex system, the TMR reliability is lower than the 
reliability of the corresponding simplex system. These problems can be overcome by using a 
TMR-Simplex system. In a TMR-Simplex system, one will have full TMR as long as all the 
three modules are functioning correctly. As soon as one of the modules becomes faulty 
(disagrees with the outputs of the other two modules), the system switches to simplex mode 
and only one fault-free module is chosen to produce outputs for subsequent operations. 

The word voter design 800 can be used to efficiently design TMR-Simplex systems as shown 
in FIG, 8. There are three flip-flops 810, 820 and 830 in design 800 and they are all clocked 
by the same clock signal (not shown in FIG. 8). Two of the flip-flops 820 and 830 have 
clock-enable (aka gated clock, load-enable) inputs (EN) as shown in FIG. 8. The flip-flops 
820 and 830 can be set or reset by an asynchronous retry signal (not shown in FIG. 8). 
Design 800 has less logic complexity compared to Sift-Out Modular Redundancy as 
described by De Sousa in De Sousa, P. T., and F. P. Mathur, "Sift-Out Modular Redundancy," 
IEEE Trans, Computers, Vol C-27, No. 7, pp. 624-627, July 1978. 
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Referring to FIG. 8, initially, when all the modules produce correct outputs, the outputs of 
module 1 are produced at the voter outputs. If one of the modules (Module 1, for example) 
fails, pair- wise matching circuits Matchi^ produces a 0 and Match2,3 produces a L As a 
result, all flip-flops 810, 820 and 830 are reset to 0, and the outputs of Module 2 are produced 
at the voter output. Thus, the system behaves as a simplex system consisting of Module 2 
only. The ERROR signal 840 will not be produced any more from this time onwards. If 
Module 2 fails, then pair- wise matching circuits Matchi^ will produce a 1 and Match2,3 will 
produce a 0 and the system will behave as a simplex system consisting of Module 1 only. If 
the output vectors (Z\ and Z^) produced by the three modules are all different, the ERROR 
signal 840 will be equal to 1. 

Note that, compared to the design in FIG. 5 one will need three extra AND gates (equivalent 
of five two-input AND gates), one extra two-input OR gate and three flip-flops, independent 
of the number of outputs. This shows the benefit obtained by using the word voter of the 
present invention in designing a TMR-simplex system. 

In general, a word voter of the present invention with n outputs for a triple modular 
redundancy simplex system includes three pair-wise matching circuits 840, 850 and 860 each 
having n XNOR gates and n 2-input AND gates (similar as to FIG. 6) to receive output 
vectors of modules (such as Z* of the triple modular redundancy simplex system. A word 
voter simplex system further includes 2n 2-input AND gates 850 and n 2-input OR gates 860 
to generate said n outputs Z^ ... Z^. Furthermore, the word voter for TMR simplex systems 
includes five two-input AND gates 850 and one two-input OR gate 860 independent of n. 
Lastly, the word voter for simplex systems includes three flip-flops 810, 820 and 830 
independent of said n. In order to generate error signal 840, the word voter for simples 
systems includes a 1 3-input NOR gate 870 and which is independent of said n. 
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In general terms, a word- voter of the present invention with n outputs for a N modular 
redundancy system can be described in two ways. First by having ( n ) matching circuits. 

These matching circuits then include n sub-circuits each comprising two \NI2 \ input AND 
gates and one 2-input OR gate. Second by having a minimum number of pair-wise matching 
circuits, wherein the minimum number is derived for each said N using a conmionly used 
covering procedure. The pair-wise matching circuits each have n XNOR gates and n 2-input 
AND gates to receive output vectors of modules of the N modular redundancy system. In 
addition, AND gates are included to combine the output vectors of the pair-wise matching 
circuits. As like TMR system discussed above, a word-voter of the present invention with n 

input NOR gate to 



outputs for a N modular redundancy system could also include one 
generate an error signal independent of n. 



' N ] 
[In/2] 



For systems with round-off errors, there is a possibility of non-exact matching of the outputs 
of the three modules. In that case, an interesting problem will be to determine thresholds. 
Then one can indicate error situations using the word voter design if the outputs of the three 
modules do not match within the threshold. 



The present invention has now been described in accordance with several exemplary 
embodiments, which are intended to be illustrative in all aspects, rather than restrictive. For 
instance, using the word voter, one can design TMR systems for which one performs word- 
wise voting for only a subset of the output bits and bit-wise voting for the remaining output 
bits. In addition, the relationships among the subsets of the outputs and the system reliability 
and data integrity can be analyzed. Thus, the present invention is capable of many variations 
in detailed implementation, which may be derived from the description contained herein by a 
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